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Abstract 

In this paper, we propose variants of forward-backward splitting method for solving the 
system of splitting inclusion problem. We propose a conceptual algorithm containing three 
variants, each having a different projection steps. The algorithm consists in two parts, the first 
and main contains an explicit Armijo-type search in the spirit of the extragradient-like methods 
for variational inequalities. In the iterative process the operator forward-backward is computed 
only one time for each inclusion problem, this represent a great computational saving if we 
compare with Tseng’s algorithm, because the computational cost of this operator is very high. 
The second part of the scheme consists in special projection steps. The convergence analysis 
of the proposed scheme is given assuming monotonicity on both operators, without assuming 
Lipschitz continuity on the forward operators. 
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1 Introduction 

First, we introduce a notation and some definitions. The inner product in M n is denoted by (■,•) 
and the norm induced by the inner product by || • ||. We denote by 2 C the power set of C. For X 
a nonempty, convex and closed subset of M n , we define the orthogonal projection of x onto X by 
Px(x), as the unique point in X , such that \\Px{x) — y\\ < ||x — y\\ for all y £ X. Let Nx{x) be 
the normal cone to A' at a; £ X , i.e., Nx(x ) = {d £ M n : (d, x — y) > 0 Vy £ X}. Recall that an 
operator T : K n —> 2 R " is monotone if, for all (x, u), (y, v ) £ Gr(T ) := {(x, u) £ M n xR n : u £ T(x)}, 
we have (x — y, u — v) >0, and it is maximal if T has no proper monotone extension in the graph 
inclusion sense. 

In this paper, we propose a modified algorithm for solving a system of splitting inclusion problem, 
for the sum of two operators. Given a finite family of pair of operators I) with I =: 

(1,2, ■ ■ ■ , m) and m £ N. The system of inclusion problem consists in: 

Find i£l" such that 0 £ ( A{ + Bi)(x) for all i £ I, (1) 
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where the operators A t : M n —>• M n are point-to-point and monotone and the operators Bi : M n —> 
2 k " are point-to-set maximal monotone operators. The solution of the problem is given by the 
interception of the solution of each component of the system, i.e., S'* = n, e iS*, where S* is defined 
as S* := {x £ R n : 0 € Ai(x ) + 

The problem (jTJ) is a generalization of the system of variational inequalities, introduced by I.V. 
Konnov in M, taking the operators Bi = Nq for all i € I, which have been studied in [SHfflini. 
A generalization of this results have been studied in mm, where the hypothesis that all Ai 
are Lipschitz continuous for all * £ I, is assumed for the convergence analysis. In this paper we 
improve this result assuming only monotonicity for all operators Aj. and maximal monotonicity 
for the operators B{. Also, we improve the linesearch proposed by Tseng in [21] . calculating in 
each tentative of find the step size, the operator forward-backward only one time for each inclusion 
problem of the system. This improves the algorithm in the computational sense, because this 
operator is very expensive to compute. The idea for this manuscript was motivated from the 

works 1SH2J. 

Problem (|T[) have many applications in operations research, mathematical physics, optimization 
and differential equations. This kind of problem have been deeply studied and has recently received 
a lot attention, due to the fact that many nonlinear problems, arising within applied areas, are 
mathematically modeled as nonlinear operator system of equations and/or inclusions, which each 
one are decomposed as sum of two operators. 


2 Preliminaries 

In this section, we present some definitions and results needed for the convergence analysis of the 
proposed algorithm. First, we state two well-known facts on orthogonal projections. 

Proposition 2.1 Let X be any nonempty, closed and convex set in M n , and Px the orthogonal 
projection onto X. For all x,y € M n and all z £ X the following hold: 

(i) || Px{x) - Px(y)\\ 2 < ||®- y|| 2 - || (Px(x) - x) - ( P x (y) - ^H 2 . 

(ii) (x - P x {x),z - P x (x)) < 0. 

(iii) P X = {I + N X )~ 1 . 

Proof, (i) and (ii) see Lemma 1.1 and 1.2 in [22] . (iii) See Proposition 2.3 in [3]. ■ 

In the following we state some useful results on maximal monotone operators. 

Lemma 2.2 Let T : dom{T ) C M n —y 2 R " be a maximal monotone operator. Then, 

(i) Gr(T) is closed. 

(ii) T is bounded on bounded subsets of the interior of its domain. 

Proof. 

(i) See Proposition 4.2.1(h) in [8j. 
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(ii) See Lemma 5(iii) in [5j. 


Proposition 2.3 Let T : dom{T) C M n —y 2 R " be a point-to-set and maximal monotone operator. 
Given f3 > 0 then the operator (/ + /3T)~ 1 : M n —> dom(T) is single valued and maximal monotone. 

Proof. See Theorem 4 in }18j . ■ 

Proposition 2.4 Given (5 > 0 and A : dom(A) C M n —>• be a monotone operator and B : 
dom(B) C M n —y 2 R " be a maximal monotone operator, then 

x = (I + (3B)- l (I - f3A)fx), 

if and only if, 0 £ (A + B)(x). 

Proof. See Proposition 3.13 in [13]. ■ 

Now we define the so called Fejer convergence. 

Definition 2.5 Let S be a nonempty subset o/M™. A sequence C R n is said to be Fejer 

convergent to S, if and only if, for all x € S there exists ko > 0, such that ||x fc+1 — x\\ < \\x k — x|| 
for all k > ko. 

This definition was introduced in [7] and have been further elaborated in m and [I]. A useful 
result on Fejer sequences is the following. 

Proposition 2.6 If {x k }k &N Fejer convergent to S, then: 

(i) the sequence is bounded; 

(ii) the sequence {\\x k — convergent for all x £ S; 

(iii) if a cluster point x* belongs to S, then the sequence {x fe }fc g N converges to x*. 

Proof, (i) and (ii) See Proposition 5.4 in [2]. (iii) See Theorem 5.5 in [2], ■ 


3 The Algorithm 

Let Ai : M n —> R n and Bi : M n —> 2 R " be maximal monotone operators, with A{ point-to-point and 
Bi point-to-set, for all i £ I. Assume that dom(Bj ) C dom(Ai), for all i E I := {1, 2,3, • • • , m} with 
m€ N. Choose any nonempty, closed and convex set, X C r\ e i dom(Bi), satisfying X n S* ^ 0. 
Thus, from now on, the solution set, S* , is nonempty. Also we assume that the operators B j 
for all i e I satisfies, that for each bounded subset V of dom(Bi) there exists R > 0, such that 
Bi(x) nB[0, .R] 7 ^ 0, for all x € V and i £ I where B[ 0, R] is the closed ball centered in 0 and radius 
R. We emphasize that this assumption holds trivially if dom(Bi) = or V C int(dom(Bi)) or Bi 
is the normal cone in any subset of dom(Bi). 

Let be a sequence such that {/3k}keN ^ [Pi fi\ with 0 < ft < ft < oo, 9,5 G (0,1), and be 

I = {1,2, 3, • • • , m}, R > 0 like assumption above. The algorithm is defined as follows: 
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Conceptual Algorithm A Let {f3 k } k £ n,0,<5, -R and I like above. 

Step 0 (Initialization): Take x° € X. 

Step 1 (Iterative Step 1 ): Given x k , compute for all i € I, 


Ji(x k a3k) ■= (I + PkBi)-\l - PkAi)(x k ). 

(2) 

Step 2 (Stopping Test 1 ): Define := {i € I : x k = Ji(x k , /3k)}- If = I stop. 

Step 3 (Inner Loop): Otherwise, for all i G I \ It begin the inner loop over j. Put j 
choose any Uy ^ € Bi(Qi Ji(x k , /3 k ) + (1 — 9^)x k ) D B[0, R], If 

= 0 and 

(Ai(PJi(x k ,p k ) + (1 - e j )x k )+ u\yyx k - Ji(x k ,p k )) > J-\\x k - Ji(x k ,/3 k ) II 2 , 

(3) 

then ji(k) := j and stop. Else, j = j + 1. 

Step 4 (Iterative Step 2): Set for all i £ I \ 


«fc,i := 

(4) 

7 A — k 

U l ■ u ji(k) 

(5) 

x k := a kji Ji(x k ,/3 k ) + (1 - a k)i )x k 

(6) 

and 

x k+l := P A (x k ). 

(7) 

Step 5 (Stop Criteria 2): If x k+1 = x k then stop. Otherwise, set k k + 1 and go to Step 1. 


We consider three variants of this algorithm. Their main difference lies in the computation ([7]): 


where 


and 


J\A^x k ) -P x (P Hk (x k ))- 

(Variant 1 A. ill 

(8) 

-7jA.2|( x ) ~ F xrH k (x ), 

(Variant \A.2\ 

(9) 

•7jX3l( x ) ~ P xr\H k nw(x k )( x )> 

(Variant IA.3I) 

(10) 

H k := 0 i<3\r k Hi{x k ,u k ) 


(11) 

Hi(x,u ) := {y € R n : ( Ai(x ) + u,y - 

- x) < 0} 

(12) 

W(x) := {y € M. n : (y — x, x° — x) 

<o}. 

(13) 


This kind of hyperplane have been used in some works, see WM- 


4 Convergence Analysis 

In this section we analyze the convergence of the algorithms presented in the previous section. First, 
we present some general properties as well as prove the well-definition of the conceptual algorithm. 
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Lemma 4.1 For all (x,u) £ Gr(Bi), S* C H, L {x,u), for all i £ I. Therefore S* C H.fx,u) for all 
i £ I. 


Proof. Take x* £ S*. Using the definition of the solution, there exists v* £ Bi(x*), such that 
0 = Ai(x*) + v*. By the monotonicity of Ai + Bi, we have 

(Ai(x :) + u - (Ai(x*) + v*),x - x*) > 0, 

for all (x,u) £ Gr(Bi). Hence, 

(. Ai(x ) + u, x* — x) <0 

and by (fl2|) . x* £ Hi{x,u). ■ 

From now on, is the sequence generated by the conceptual algorithm. 

Proposition 4.2 The conceptual algorithm is well-defined. 


Proof. By Proposition 12.41 Stop Criteria 1 is well-defined. The proof of the well-definition of 
ji(k) is by contradiction. Fix i £ I \ and assume that for all j > 0 having chosen u k _ ^ £ 
B i (^J i (x fe ,/3 jfc ) + (l-^)x fe ) nB[0,R], 

(Ai(PJi(x k ,l3 k ) + (1 - V)x k )+u’j,x k - Ji{x k ,/3 k )) < ^\\x k - Ji(x k ,p k )|| 2 . 

Since the sequence ^}°T 0 i s bounded, there exists a subsequence {'Uy. ^°f { u 0 'j)}^=o> 

which converges to an element u k belonging to Bi(x k ) by maximality. Taking the limit over the 
subsequence we get 

(/ %Ai{x k ) + /3 k u k ,x k - Ji{x k ,/3 k )) < 5\\x k - Ji(x k ,/3 k ) || 2 . (14) 

It follows from (J^J) that 

hMx k ) = x k - Ji(x k ,p k ) - p k vl 

for some v k £ Bi(Ji(x k , f3 k ))- 

Now, the above equality together with (1 14[) . lead to 

\\x k - Ji(x k ,/3 k )\\ 2 < (x fc - Ji(x k ,p k ) - p k v k + p k u k ,x k - Ji(x k ,/3 k )) < 5\\x k - Ji(x k ,/3 k )|| 2 , 
using the monotonicity of Bi for the first inequality. So, 

(l-6)\\x k -Mx k ,fl k )\\ 2 <0, 


which contradicts that i £ I \ . 


Thus, the conceptual algorithm is well-defined. 


Proposition 4.3 x k £ H k if and only if, x k £ S*. 


Proof. If x k £ H k then x k £ Hj(x k ,u k ) for all i £ I \ by dehnition of H k . Now by Proposition 
(4.2) of [B] we have that x k £ S* for all i £ I, then x k £ S*. Conversely, if x k £ S* then x k £ S* 
then x k £ Hi(x k ,u k ) for all i £ I using the same proposition, implying that x k £ H k . ■ 

Finally, a useful algebraic property on the sequence generated by the conceptual algorithm, which 
is a direct consequence of the inner loop and ©. 
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Corollary 4.4 Let {x fc }fc G N; {/3fc}fceN and {a(fc i? :)}A,-eN be sequences generated by the conceptual 
algorithm. With 6 and f3 as in the conceptual algorithm. Then, 

(Ai(xi) +u k i,x k -x k ) > < ^Y~\\x k - Ji(x k ,f3 k )\\ 2 > 0, (15) 

for all k. 

4.1 Convergence analysis of Variant I A. II 

In this section, all results are for Variant IA.ll which is summarized below. 

Variant A.l x k+1 = 3 \]ff\{ x k ) = Px(PH k (x k )) 

Proposition 4.5 If Variant IA.ll stovs. then x k £ S*. 

Proof. If Stop Criteria 2 is satisfied, x k+l = Px {Pu k (x k )) = x k . Using Proposition 12.U ni, we have 

(P Hk (x k )-x k ,z-x k )< 0, (16) 

for all z £ X. Now using Proposition 12. ll ii). 

(P„,(x k )-x\P Hk (x k )-z)< 0. (17) 

for all z £ Hk. Since X n Hk ^ 0 summing (fT 6 l) and with z £ X D Hk, we get 

II*‘-.p»,(*‘)II 2 = o. 

Hence, x k = Pn k {x k ), implying that x k £ Hk and by Proposition 14.31 x k £ S*. ■ 

Proposition 4.6 (i) The sequence is Fejer convergente to S* fl X. 

(ii) The sequence bounded. 

(ih) hnifc^oo || P Hk {x k ) - x k \\ 2 = 0 . 

(iv) lim^oo \\x x+l - x fc || 2 = 0 . 

Proof, (i) Take x* £ S* fl X. Using (JS]), Proposition 12 . ll ii and Lemma ITT! we have 

\\x k+1 -x*\\ 2 = ||P A -(PHj^))-P A -(PHjx*))|| 2 <||P^(x fc )-P^(x *)|| 2 

< \\x k -x*\\ 2 -\\P Hk (x k )-x k \\ 2 . (18) 

So, ||x fc+1 — x*|| < \\x k — x*||. (ii) Follows immediately from item (i). (iii)Take x* £ S* fl X. Using 
(fl 8 l) yields 

|| P Hk (x k ) - x k \\ 2 < \\x k - x *|| 2 - ||x fc+1 - x* || 2 . (19) 

Now using Proposition 12.61 and item (i) we have that the right side of equation (|19l) go to zero. 
Obtaining the result, (iv) Since the sequence belong to X, we have, 

ll *‘ +1 - i'*l | 2 = II Px(PhAX) ~ Px(x h ) || 2 < || P Hk (X ~ i‘P- 
Taking limits in the above equation and using the previous item we have the result. ■ 
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Proposition 4.7 For all i £ I we have, 


lim (Ai{x^) + u k ,x k -x k ) = 0 . 

/c—>oo 


Proof. For all i € I. Using Proposition 12.1 T il and the fact that Hf, c H{x k ,u k ) by (fTll) . we have 
that, 


\\x k+1 -x*\\ 2 =\\P x (P Hk (x k )) -P x (x*)\\ 2 < \\P Hk (x k )-x*\\ 2 
= 11 P Hk (x k ) - P H(x k ,u k ) (**) + P H^,u*)(x k ) - X* 

<11 P H k {x k ) - X k \\ 2 + || P H^,u^)(x k ) ~ Z*|| 2 . 

Now using Proposition l2.in i and reordering (l20l) . we get, 

„fc +1 * 112 


( 20 ) 


\ P H(x*,u!?)(x ) - ^ II < Ik - ®*|r - Ik - + II P H k (x k ) - X 


k ||2 


Using the fact that, 


H(x?,uf) 

and the previous equation, we have, 

(( Ai(x k ) + u k ,x k - x k )) 2 

\\Mxi) + u k || 2 


/ A ■ (I pr.k ™/c _ ™/c\ 


Piki) +«■ 


U fc ll2 


< ik fc -x*ll 2 - lk fc+1 -®1 2 +1| p H k (x k ) -x k \\ 2 


( 21 ) 


By Proposition 12.31 and the continuity of Aj we have that Jj is continuo, since {akjfceN and 
{/3k}ke n are bounded then { Ji(x k , Pk)}keN and are bounded, implying the boundedness of 

{||A(kiO + ^lllfceN for all i € I. 

Using Proposition 12.61 111 and (iii), the right side of (1211) goes to 0, when k goes to oo, establishing 
the result. ■ 

Next we establish our main convergence result on Variant IA.ll 

Theorem 4.8 The sequence {akjfcgpj converges to some element belonging to S* n X. 

Proof. We claim that there exists a cluster point of {ak}fc e pj belonging to S*. The existence of 
the cluster points follows from Proposition I4.6f ii). Let {a; J ' fc }fceN be a convergent subsequence of 
{x A: }fc € N such that, for all i G I the sequences {x^keN, {ufkfceN, i a j k AkeN and {/3j k }ke n are 
convergents, and lim^oo x^ k = x. 

Using Proposition I4.6i iiil and taking limits in (fT51) over the subsequence {'jk}k&h w e have for all 
i G I, 

0 = lim (Aj(xk) + — xj k ) > lim OL ^ k f ||ak — Jj (ak=,/3j fc )|| 2 > 0. (22) 

k—> oo k — Ycc> 

Therefore, 

lim a jkt i\\x jk - Ji(x jk ,P jk )\\ = 0. 

k—> oo 

Now consider the two possible cases. 
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(a) First, assume that lim^oo aj k> i / 0, i.e., ctj k i > a for all k and some a > 0. In view of 


lim \\x jk - Ji(x jk ,(3j k ) || = 0. 


k—>oo 


( 23 ) 


Since J* is continuous, by the continuity of Ai and (/ + /3 k Bi) 1 and by Proposition 12.31 
becomes 

x = MxJ), 

which implies that x G S* for all i £ I. Then x G S* establishing the claim. 

(b) On the other hand, if lim^t*, aj kj i = 0 then for 9 G (0,1) as in the conceptual algorithm, 
have 

a- 


we 


x 3k,i 


lim 

k—> oo u 


= 0 . 


Define 

Then, 


yi* - + (l - 


lim iA k = x. 

k —^oo 


(24) 


Using the definition of the ji(k) and (2J), we have that y? k does not satisfy ([3]) implying 

( A i(y 3 i k ) + u 5i(fc)-i “ ~ Ji{x k ,/3 k )),x k - Ji{x k ,fi k )^ > 0, 

equivalent to 

( A i{y J i k ) + u jti k )-i,v xk ~ J i{x k iPk)) > jA\x k ~ Ji(x k ,fi k )f, (25) 

for j G B t (yj k ) and all A; G N and * G I. 

Redefining the subsequence \jk}k&h if necessary, we may assume that ,;}feeN converges 

to Ui . By the maximality of B-i, U{ belongs to Bi(x). Using the continuity of Jj, {J(x Jk , /3j k )} k en 
converges to Ji(x,j3). Using ([24]) and taking limit in (1251) over the subsequence {j k } k £ n, we have 

^i(x) + «i, 5 - Jj(x, /3)^ < \\x - Ji{x, /3)|| 2 . (26) 

y 

Using © and multiplying by f3 on both sides of (I26[) . we get 

(x - Ji(x,/3) - fivi + f3ui,x - Ji(x,fi )) < <S[|5 - Ji(x,(3 )|| 2 , 
where V{ G Bi(Ji(x, (3)). Applying the monotonicity of Bi, we obtain 

\\x - Ji(x,/3 )|| 2 < (5||£ - Ji(x,j3 )|| 2 , 

implying that ||x — Ji(x,/3)\\ < 0. Thus, x = Ji(x,(3) and hence, x G S* for all i G I, thus x G S*. 





4.2 Convergence analysis of Variant IA.2I 

In this section, all results are for Variant IA.21 which is summarized below. 


Variant A.2 x k+1 = J \Xoj x k ) = PxnH k (x k ) 

Proposition 4.9 If Variant IA.2I stovs. then x k G S*. 

Proof. If x k+1 = PxnH k (x k ) = x k then x k G X n H\ and by Proposition 14.31 x k G S* D X. ■ 
From now on assume that Variant IA. 21 does not stop. 

Proposition 4.10 The sequence is Fejer convergent to S* D X. Moreover, it is bounded 

and 

lim ||x fc+1 — x fc || = 0 . 

k —^oo 

Proof. Take x* G S* n X. By Lemma 14.11 x* G n X , for all k. Then using Proposition I2.11 iil 

and (|9j) 

||x fc+1 - x *|| 2 - \\x k - x *|| 2 + ||x fc+1 - x k \\ 2 = 2(x* - x k+ \x k - x k+1 ) < 0 , 

we obtain 

\\x k+1 - x*|| 2 < \\x k - x*|| 2 - ||x fc+1 - x fc || 2 . (27) 

The above inequality implies that {x A: }fc e N is Fejer convergent to S* D X. Hence by Proposition 
12.61 7) and (ii), is bounded and thus {||x fc — ®*||}fceN is a convergent sequence. Taking limits 

in m, we get 

lim ||x fe+1 - x k \\ = 0 . 

k—> oo 


The next proposition shows a relation between the projection steps in Variant IA.ll and IA. 2 I 
This fact has a geometry interpretation, since the projection of Variant IA.2l is done over a small 
set, improving the convergence of Variant IA.ll Note that this can be reduce the number of 
iterations, avoiding possible zigzagging of Variant IA.ll 

Proposition 4.11 Let the sequence generated by Variant IA.21 Then, 

(i) x k+1 = PxnH k (P Hk (x k )). 

(ii) For all i G I we have, \mik^. 00 {Ai{x k ) + u k ,x k — x k ) = 0. 

Proof, (i) Fix any y G X fl H^. Since x k G X but x k ^ Hj. by Proposition 14.31 there exists 7 G [0,1], 
such that x = 'yx k + (1 — 7 )y Gin dHk■ Hence, 

\\y - P Hk {x k )\\ 2 > (l- 7 ) 2 ||y-i , H fc (x*)|| a 

= \\x-^yx k - (1 --f)P Hk (x k )\\ 2 

= II* - p H k ( x k )\\ 2 + 1 2 \\x k - P Hk {x k )|| 2 - 2 7 (x - P Hk (x k ),x k - P Hk {x k )) 

> Wx-P Hk {x k ) II 2 , ( 28 ) 
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where the last inequality follows from Proposition 12. If ni, applied with X = Hk, x = x k and 
z = x £ Hk- Furthermore, we have 


x-P Hk {x k ) || 


> \\x - x k \\ - \\x k - P Hk (x k )W 

> \\x k+1 - x k \\ - \\x k - P Hk (x k )W 

> \\x k+1 - x k \\ 

> \\x k+1 - P Hk (x k )\\, 


(29) 


where the first equality follows by the triangle inequality, using the fact that x £ X n H & and 
x k+1 = PxnH k (x k ) in the second inequality, the third one is trivial, and the last one inequality by 
the fact that x k+1 £ Hk and Proposition 12.lf i) with X = Hk- Combining (|28l) and (f29j) . we obtain 

for all y £ X n Hy. Hence, x k+1 — PxnH k (PH k (x k )). 

(ii) Take x* € X n S*. By item (i), Lemma 14.11 and Proposition 12. lf i). we have 

ll* fc+1 -*1 2 = \\PxnH k (P Hk (x k )) - P XnHk (x*)\\ 2 < \\P Hk (x k )-x*f. 


The proof is similar to the proof of Proposition 14.71 ■ 

Finally we present the convergence result for Variant IA.21 

Theorem 4.12 The sequence converges to some point belonging to S* fll. 

Proof. Repeat the proof of Theorem 14.81 ■ 


4.3 Convergence analysis of Variant IA.3I 

In this section, all results are for Variant IA.3I which is summarized below. 


Variant A.3 x k+1 = Jfj^jx k ) = P X nH k nW{x*) ( x °) 


Proposition 4.13 //Variant IA.3I stops, then x k £ S* D X. 

Proof. If Stop Criteria 2 is satisfied then, x k+1 = PxnH k nw k (x°) = x k . So, x k £ X D Hk D Wk C 
X ft Hk and finally using Proposition 14.31 x k £ S* fl X. ■ 

From now on we assume that Variant IA.3I does not stop. Observe that, in virtue of their 
definitions, Wk and Hk are convex and closed sets, for each k. Therefore X 0 Hk O Wk is a convex 
and closed set. So, if X 0 Hk C Wk is nonempty, then the next iterate, x k+1 , is well-defined. The 
following lemma guarantees this fact. 

Lemma 4.14 S* Cl X C Hk D Wk, for all k. 
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Proof. We proceed by induction. By definition, S* n X / 0. By Lemma H~T1 S* fl X C H k , for all 
k. For k = 0, as W 0 = W 1 , S* n X C H 0 n W 0 . 

Assume that S* n X C (~l Wg, for £ < k. Henceforth, x k+l = PxnH k nw k (x° ) is well-defined. 
Then, by Proposition 12. lH iL we have 

(x* - x k+1 , x° - x k+l ) = (x* - PxrH k nw k (x°) , x° - PxrH k nw k (x 0 )) < 0, (30) 

for all i* £ S' fl X. The inequality follows by the induction hypothesis. Now, (l30|) implies that 
x* € Wk+\ and hence, S'fll C H k +\ n Wk+i- ■ 

The above lemma shows that the set X n Hf : n is nonempty and in consequence the projection 
step, given in (fTOll . is well-defined. 

Corollary 4.15 Variant IA.3I is well-defined. 


Proof. By Lemma T4.14I , S* n X C H k n Wk, for all k. Then, given x°, the sequence is 

computable. ■ 

Before proving the convergence of the sequence, we study its boundedness. The next lemma 
shows that the sequence remains in a ball determined by the initial point. 


Lemma 4.16 The sequence bounded. Furthermore, 


{x k } k£N C B 


1, 0 , 1 ' 
-(x +x),-p 


n x, 


where x = Ps*nx(x°) and p = dist(x°, S'fll). 


Proof. S* fl X C Hf. n W k follows from Lemma 14.141 Moreover, from (HOD , we obtain that 

||x fc+1 - x°|| < \\z - x°||, (31) 

for all k and all z € S* n X. Henceforth, taking z = x in (l3ll) . 

\\x k+1 — x°|| < ||x — x°|| = p, (32) 

for all k. Thus, {x fe }fc g N is bounded. Define z k = x k — -^(x 0 + x) and z = x — |(x° + x). It follows 
from the fact x € W k + 1 , that 

0 > 2(x - x fc+1 ,x° - x fc+1 ) 

= 2 (z + ^(x° + x) - z k+l ~\(x° + x), z° + i(x° + x) - z k+l - ~(x° + S) \ 

= 2 (z- z k+l ,z° - z k+lX ] = (z - z k+1 , -z - z k+1 ^ = ||^ fc+1 || 2 - p|| 2 , 


where we have used that z 


—z° in the third equality. So, 


fc+i 

x — 


x° T x 



x° T x 

< 

x- 


2 


P 

2 ’ 


for all k. Now, the result follows from the feasibility of {x^’jfcgN, which, in turn, is a consequence 
of (HDD. ■ 

Now, we focus on the properties of the accumulation points. 
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Lemma 4.17 All accumulation points of {x k } k& ^ belong to S* n X. 

Proof. Since x k+1 G W k , 

0 > 2(x k+1 - x k , x° - x k ) = \\x k+1 - x k \\ 2 - ||x fe+1 - x °|| 2 + \\x k - x°|| 2 . 

Equivalently 

0 < ||x fc+1 - x k \\ 2 < ||x fc+1 - x °|| 2 - \\x k - x°|| 2 , 

establishing that the sequence {||x fc — x°||}j, g f 5 } is monotone and nondecreasing. From Lemma [4.161 
we get that {||x fc — x°||}fc g ^ is bounded, and thus, convergent. Therefore, 

lim ||x fe+1 -x k \\ =0. (33) 

k —^oo 

Since x k+1 G H k , we get for all i G I that, 

(Mx k ) + U k ,x k+1 -X k )< 0, (34) 

with u k and x k as © and (J 6 )). 

Using Q and (l34l) . we have 

(A(x k ) + u k ,x k+1 - x k ) + a k!i (Mx k ) + u k ,x k - Ji{x k ,p k )) < 0. 

Combining the above inequality with the stop criteria of Inner Loop, given in Q, we get for all 
i G I 

(A(x k ) +u k ,x k+1 -x k ) + ^\\x k - Mx k ,A) II 2 < o. (35) 

Choosing a subsequence {j k }k eN such that the subsequences {x 3k } ke ^, {Pj k }ke N and {AAkeN 
converge to x, $ and fq respectively. This is possible by the boundedness of {uk}j, gN , by hypothesis 
on Bi, bounded of {x fc }j, g N and {/^jjjgpj. Taking limits in (1351) . we have 

lim a^iWx^ - J i (x 3k ,P jk ) II 2 = 0 . (36) 

k—> oo 

Now we consider two cases, limj ; _>. 00 ctj kt i = 0 or limj^oo otj k> i / 0 (taking a subsequence again if 
necessary). 

(a) limj._j.oo a.j ky i 7 ^ 0, i.e., for ah i G I, ctj k ,i > di for all k and some d{ > 0. By (|36j) . 

lim \\x lk - J (x lk ,/3 ik )\\ 2 = 0. 

k—foe 

By continuity of J l , we have x = Ji(x,j3) and hence by Proposition 12.41 x G S* for all i G I, therefor 
x G S'*. 

(b) limj-^oo OLj k> i = 0, then limj._j.oo = 0. It follows in the same, manner as in the proof of 

Theorem 14.81 b) . ■ 

Finally, we are ready to prove the convergence of the sequence {x fc }j, g fs} generated by Variant IA.31 
to the solution closest to x°. 

Theorem 4.18 Define x = T’s'*nx(x°). Then, {x fc }j. g f*j converges to x. 
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Proof. By Lemma 14.161 {x k } k& N C B [i(x° + x), \p] n X, so it is bounded. Let be a 

convergent subsequence of {x k }k£f^, and let x be its limit. Evidently x € B [^(x° + x), \p\ n X. 
Furthermore, by Lemma 14.171 Then, 


x £ s* n x n b 


1, o . 1 

-{x +x),-p 


M, 


implying that x = x, hence x is the unique limit point of {x fc } fcgN . Thus, converges to 

x£S* ni. ■ 


5 Conclusions 

In this paper, we present a variant of forward-backward splitting methods for solving a system 
o inclusion problems composed by the sum of two operators. A conceptual algorithm have been 
proposed containing three variants with different projections steps. A linesearch, for relax the 
hypothesis of Lipschitz continuity on forwards operators, have been proposed. The convergence 
analyse of three variant are discussed. The results presented here, improve the previous in the 
literature by relaxing the hypothesis. 
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